Papers with spatial probing task
Pre-Trained Language Models Represent Some Geographic Populations Better than Others (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have focused on measuring the degree to which pre-trained language models capture purely linguistic knowledge and reasoning abilities and world knowledge. |
| Approach: | They use geography to demarcate different populations around the world and comparable corpora to measure how well two families of LLMs perform across these different populations. |
| Outcome: | The results show that pre-trained models perform better for some populations than others. |